Computer-implemented system and method for analyzing clusters of coded documents

ABSTRACT

A computer-implemented system and method for analyzing clusters of coded documents is provided. Clusters of documents are displayed and at least a portion of the documents are each associated with a classification code. A representation of each document is provided based on the associated classification code or an absence of the associated classification code. A search query with search terms is received. Each search term is associated with one of the classification codes. Those documents that satisfy the search query are identified and the representations of the identified documents are changed based on the classification codes associated with the search terms. The change in representation provides an indication of agreement between the classification code of such document and the classification codes of the search terms, or an indication of disagreement between the classification code of the document and the classification codes of the search terms.

CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application is a continuation of U.S. patent applicationSer. No. 17/351,949, filed Jun. 18, 2021 [Attorney file number121324-12205], which is a continuation of U.S. patent application Ser.No. 15/612,412, filed Jun. 2, 2017 [Attorney file number 121324-12201],which claims priority under 35 U.S.C. § 119(e) to U.S. ProvisionalPatent Application, Ser. No. 62/344,986, filed Jun. 2, 2016, thecontents of each of which are incorporated by reference.

FIELD

The invention relates in general to user interfaces and, in particular,to a computer-implemented system and method for analyzing clusters ofcoded documents.

BACKGROUND

Text mining can be used to extract latent semantic content fromcollections of structured and unstructured text. Data visualization canbe used to model the extracted semantic content, which transformsnumeric or textual data into graphical data to assist users inunderstanding underlying semantic principles. For example, clustersgroup sets of concepts into a graphical element that can be mapped intoa graphical screen display. When represented in multi-dimensional space,the spatial orientation of the clusters reflect similarities andrelatedness. However, forcibly mapping the display of the clusters intoa three-dimensional scene or a two-dimensional screen can cause datamisinterpretation. For instance, a viewer could misinterpret dependentrelationships between adjacently displayed clusters or erroneouslymisinterpret dependent and independent variables. As well, a screen ofdensely-packed clusters can be difficult to understand and navigate,particularly where annotated text labels overlie clusters directly.Other factors can further complicate visualized data perception, such asdescribed in R. E. Horn, “Visual Language: Global Communication for the21st Century,” Ch. 3, MacroVU Press (1998), the disclosure of which isincorporated by reference.

Physically, data visualization is constrained by the limits of thescreen display used. Two-dimensional visualized data can be accuratelydisplayed, yet visualized data of greater dimensionality must beartificially projected into two-dimensions when presented onconventional screen displays. Careful use of color, shape and temporalattributes can simulate multiple dimensions, but comprehension andusability become increasingly difficult as additional layers areartificially grafted into the two-dimensional space and screen densityincreases. In addition, large sets of data, such as email stores,document archives and databases, can be content rich and can yield largesets of clusters that result in a complex graphical representation.Physical display space, however, is limited and large cluster sets canappear crowded and dense, thereby hindering understandability. To aidnavigation through the display, the cluster sets can be combined,abstracted or manipulated to simplify presentation, but semantic contentcan be lost or skewed.

Moreover, complex graphical data can be difficult to comprehend whendisplayed without textual references to underlying content. The user isforced to mentally note “landmark” clusters and other visual cues, whichcan be particularly difficult with large cluster sets. Visualized datacan be annotated with text, such as cluster labels, to aid comprehensionand usability. However, annotating text directly into a graphicaldisplay can be cumbersome, particularly where the clusters are denselypacked and cluster labels overlay or occlude the screen display. A moresubtle problem occurs when the screen is displaying a two-dimensionalprojection of three-dimensional data and the text is annotated withinthe two-dimensional space. Relabeling the text based on thetwo-dimensional representation can introduce misinterpretations of thethree-dimensional data when the display is reoriented. Also, reorientingthe display can visually shuffle the displayed clusters and cause a lossof user orientation. Furthermore, navigation can be non-intuitive andcumbersome, as cluster placement is driven by available display spaceand the labels may overlay or intersect placed clusters.

Therefore, there is a need for providing a user interface for focuseddisplay of dense visualized three-dimensional data representingextracted semantic content as a combination of graphical and textualdata elements. Preferably, the user interface would facilitateconvenient navigation through a heads-up display (HUD) logicallyprovided over visualized data and would enable large- or fine-graineddata navigation, searching and data exploration.

SUMMARY

An embodiment provides a system and method for providing a userinterface for a dense three-dimensional scene. Clusters are placed in athree-dimensional scene arranged proximal to each other such cluster toform a cluster spine. Each cluster includes one or more concepts. Eachcluster spine is projected into a two-dimensional display relative to astationary perspective. Controls operating on a view of the clusterspines in the display are presented. A compass logically framing thecluster spines within the display is provided. A label to identify onesuch concept in one or more of the cluster spines appearing within thecompass is generated. A plurality of slots in the two-dimensionaldisplay positioned circumferentially around the compass is defined. Eachlabel is assigned to the slot outside of the compass for the clusterspine having a closest angularity to the slot.

A further embodiment provides a system and method for providing adynamic user interface for a dense three-dimensional scene with anavigation assistance panel. Clusters are placed in a three-dimensionalscene arranged proximal to each other such cluster to form a clusterspine. Each cluster includes one or more concepts. Each cluster spine isprojected into a two-dimensional display relative to a stationaryperspective. Controls operating on a view of the cluster spines in thedisplay are presented. A compass logically framing the cluster spineswithin the display is provided. A label is generated to identify onesuch concept in one or more of the cluster spines appearing within thecompass. A plurality of slots in the two-dimensional display is definedpositioned circumferentially around the compass. Each label is assignedto the slot outside of the compass for the cluster spine having aclosest angularity to the slot. A perspective-altered rendition of thetwo-dimensional display is generated. The perspective-altered renditionincludes the projected cluster spines and a navigation assistance panelframing an area of the perspective-altered rendition corresponding tothe view of the cluster spines in the display.

A still further embodiment provides a computer-implemented system andmethod for analyzing clusters of coded documents. A display of clustersof documents is provided and at least a portion of the documents in thedisplay are each associated with a classification code. A representationof each of the documents is provided within the display based on one ofthe associated classification code and an absence of the associatedclassification code. A search query is received and includes one or moresearch terms. Each search term is associated with one of theclassification codes based on the documents. Those documents thatsatisfy the search query are identified and the representations of theidentified documents are changed based on the classification codesassociated with one or more of the search terms. The change inrepresentation provides one of an indication of agreement between theclassification code associated with one such document and theclassification codes of the one or more search terms, and an indicationof disagreement between the classification code associated with thedocument and the classification codes of the search terms.

Still other embodiments of the invention will become readily apparent tothose skilled in the art from the following detailed description,wherein are embodiments of the invention by way of illustrating the bestmode contemplated for carrying out the invention. As will be realized,the invention is capable of other and different embodiments and itsseveral details are capable of modifications in various obviousrespects, all without departing from the spirit and the scope of theinvention. Accordingly, the drawings and detailed description are to beregarded as illustrative in nature and not as restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a system for providing a userinterface for a dense three-dimensional scene, in accordance with theinvention.

FIGS. 2A-B are block diagrams showing the system modules implementingthe display generator of FIG. 1 .

FIG. 3 is a block diagram showing, by way of example, the projection ofn-dimensional space into three-dimensional space and two-dimensionalspace through the display generator of FIG. 1 .

FIGS. 4A-C are screen display diagrams showing, by way of example, auser interface generated by the display generator of FIG. 1 .

FIG. 5 is an exploded screen display diagram showing the user interfaceof FIGS. 4A-C.

FIGS. 6A-D are data representation diagrams showing, by way of examples,display zooming, panning and pinning using the user interface of FIGS.4A-C.

FIG. 7 is a data representation diagram showing, by way of example,multiple compasses generated using the user interface of FIGS. 4A-C.

FIGS. 8A-C are data representation diagrams showing, by way of example,single and multiple compasses generated using the user interface ofFIGS. 4A-C.

FIG. 9 is a data representation diagram showing, by way of example, acluster spine group.

FIG. 10 is a data representation diagram showing, by way of examples,cluster spine group placements.

FIG. 11 is a data representation diagram showing, by way of example,cluster spine group overlap removal.

FIG. 12 is a flow diagram showing a method for providing a userinterface for a dense three-dimensional scene, in accordance with theinvention.

FIG. 13 is a flow diagram showing the routine for providing a HUD foruse in the method of FIG. 12 .

FIG. 14 is a flow diagram showing the routine for assigning clusters toslots for use in the routine of FIG. 13 .

FIG. 15 is a data representation diagram showing, by way of example, acluster assignment to a slot within a slice object.

FIGS. 16 and 17 are screen display diagrams showing, by way of example,an alternate user interface generated by the display generator of FIG. 1.

FIG. 18 is a screenshot showing, by way of example, a codingrepresentation for each cluster.

FIG. 19 is a screenshot showing, by way of example, document clusterswith keyword highlighting.

FIG. 20 is a screenshot showing, by way of example, documents clusterswithout search term highlighting.

DETAILED DESCRIPTION Glossary

-   -   Concept: One or more preferably root stem normalized words        defining a specific meaning.    -   Theme: One or more concepts defining a semantic meaning.    -   Cluster: Grouping of documents containing one or more common        themes.    -   Spine: Grouping of clusters sharing a single concept preferably        arranged linearly along a vector. Also referred to as a cluster        spine.    -   Spine Group: Set of connected and semantically-related spines.    -   Scene: Three-dimensional virtual world space generated from a        mapping of an n-dimensional problem space.    -   Screen: Two-dimensional display space generated from a        projection of a scene limited to one single perspective at a        time.

The foregoing terms are used throughout this document and, unlessindicated otherwise, are assigned the meanings presented above.

System Overview

FIG. 1 is a block diagram showing a system 10 for providing a userinterface for a dense three-dimensional scene, in accordance with theinvention. By way of illustration, the system 10 operates in adistributed computing environment, which includes a plurality ofheterogeneous systems and document sources. A backend server 11 executesa workbench suite 31 for providing a user interface framework forautomated document management, processing and analysis. The backendserver 11 is coupled to a storage device 13, which stores documents 14,in the form of structured or unstructured data, and a database 30 formaintaining document information. A production server 12 includes adocument mapper 32, that includes a clustering engine 33 and displaygenerator 34. The clustering engine 33 performs efficient documentscoring and clustering, such as described in commonly-assigned U.S. Pat.No. 7,610,313, issued Oct. 27, 2009, the disclosure of which isincorporated by reference. The display generator 34 arranges conceptclusters in a radial thematic neighborhood relationships projected ontoa two-dimensional visual display, such as described in commonly-assignedU.S. Pat. No. 7,191,175, issued Mar. 13, 2007, and U.S. Pat. No.7,440,622, issued Oct. 21, 2008, the disclosures of which areincorporated by reference. In addition, the display generator 34provides a user interface for cluster display and navigation, as furtherdescribed below beginning with reference to FIGS. 2A-B.

The document mapper 32 operates on documents retrieved from a pluralityof local sources. The local sources include documents 17 maintained in astorage device 16 coupled to a local server 15 and documents 20maintained in a storage device 19 coupled to a local client 18. Thelocal server 15 and local client 18 are interconnected to the productionsystem 11 over an intranetwork 21. In addition, the document mapper 32can identify and retrieve documents from remote sources over aninternetwork 22, including the Internet, through a gateway 23 interfacedto the intranetwork 21. The remote sources include documents 26maintained in a storage device 25 coupled to a remote server 24 anddocuments 29 maintained in a storage device 28 coupled to a remoteclient 27.

The individual documents 17, 20, 26, 29 include all forms and types ofstructured and unstructured data, including electronic message stores,such as word processing documents, electronic mail (email) folders, Webpages, and graphical or multimedia data. Notwithstanding, the documentscould be in the form of organized data, such as stored in a spreadsheetor database.

In one embodiment, the individual documents 17, 20, 26, 29 includeelectronic message folders, such as maintained by the Outlook andOutlook Express products, licensed by Microsoft Corporation, Redmond,Wash. The database is an SQL-based relational database, such as theOracle database management system, release 8, licensed by OracleCorporation, Redwood Shores, Calif.

The individual computer systems, including backend server 11, productionserver 32, server 15, client 18, remote server 24 and remote client 27,are general purpose, programmed digital computing devices consisting ofa central processing unit (CPU), random access memory (RAM),non-volatile secondary storage, such as a hard drive or CD ROM drive,network interfaces, and peripheral devices, including user interfacingmeans, such as a keyboard and display. Program code, including softwareprograms, and data are loaded into the RAM for execution and processingby the CPU and results are generated for display, output, transmittal,or storage.

Display Generator

FIGS. 2A-B are block diagrams showing the system modules 40 implementingthe display generator of FIG. 1 . Referring first to FIG. 2A, thedisplay generator 34 includes clustering 41, cluster spine placement 42,and HUD 43 components.

Individual documents 14 are analyzed by the clustering component 41 toform clusters 45 of semantically scored documents, such as described incommonly-assigned U.S. Pat. No. 7,610,313, issued Oct. 27, 2009, thedisclosure of which is incorporated by reference. In one embodiment,document concepts 46 are formed from concepts and terms extracted fromthe documents 14 and the frequencies of occurrences and reference countsof the concepts and terms are determined. Each concept and term is thenscored based on frequency, concept weight, structural weight, and corpusweight. The document concept scores are compressed and assigned tonormalized score vectors for each of the documents 14. The similaritiesbetween each of the normalized score vectors are determined, preferablyas cosine values. A set of candidate seed documents is evaluated toselect a set of seed documents 44 as initial cluster centers based onrelative similarity between the assigned normalized score vectors foreach of the candidate seed documents or using a dynamic threshold basedon an analysis of the similarities of the documents 14 from a center ofeach cluster 45, such as described in commonly-assigned U.S. Pat. No.7,610,313, issued Oct. 27, 2009, the disclosure of which is incorporatedby reference. The remaining non-seed documents are evaluated against thecluster centers also based on relative similarity and are grouped intothe clusters 45 based on best-fit, subject to a minimum fit criterion.

The clustering component 41 analyzes cluster similarities in amulti-dimensional problem space, while the cluster spine placementcomponent 42 maps the clusters into a three-dimensional virtual spacethat is then projected onto a two-dimensional screen space, as furtherdescribed below with reference to FIG. 3 . The cluster spine placementcomponent 42 evaluates the document concepts 46 assigned to each of theclusters 45 and arranges concept clusters in thematic neighborhoodrelationships projected onto a shaped two-dimensional visual display,such as described in commonly-assigned U.S. Pat. No. 7,191,175, issuedMar. 13, 2007, and U.S. Pat. No. 7,440,622, issued Oct. 21, 2008, thedisclosures of which are incorporated by reference.

During visualization, cluster “spines” and certain clusters 45 areplaced as cluster groups 49 within a virtual three-dimensional space asa “scene” or world 56 that is then projected into two-dimensional spaceas a “screen” or visualization 54. Candidate spines are selected bysurveying the cluster concepts 47 for each cluster 45. Each clusterconcept 47 shared by two or more clusters 45 can potentially form aspine of clusters 45. However, those cluster concepts 47 referenced byjust a single cluster 45 or by more than 10% of the clusters 45 arediscarded. Other criteria for discarding cluster concepts 47 arepossible. The remaining clusters 45 are identified as candidate spineconcepts, which each logically form a candidate spine. Each of theclusters 45 are then assigned to a best fit spine 48 by evaluating thefit of each candidate spine concept to the cluster concept 47. Thecandidate spine exhibiting a maximum fit is selected as the best fitspine 48 for the cluster 45. Unique seed spines are next selected andplaced. Spine concept score vectors are generated for each best fitspine 48 and evaluated. Those best fit spines 48 having an adequatenumber of assigned clusters 45 and which are sufficiently dissimilar toany previously selected best fit spines 48 are designated and placed asseed spines and the corresponding spine concept 50 is identified. Anyremaining unplaced best fit spines 48 and clusters 45 that lack best fitspines 48 are placed into spine groups 49. Anchor clusters are selectedbased on similarities between unplaced candidate spines and candidateanchor clusters. Cluster spines are grown by placing the clusters 45 insimilarity precedence to previously placed spine clusters or anchorclusters along vectors originating at each anchor cluster. As necessary,clusters 45 are placed outward or in a new vector at a different anglefrom new anchor clusters 55. The spine groups 49 are placed bytranslating the spine groups 49 in a radial manner until there is nooverlap, such as described in commonly-assigned U.S. Pat. No. 7,271,804,issued Sep. 18, 2007, the disclosure of which is incorporated byreference.

Finally, the HUD generator 43 generates a user interface, which includesa HUD that logically overlays the spine groups 49 placed within thevisualization 54 and which provides controls for navigating, exploringand searching the cluster space, as further described below withreference to FIGS. 4A-C. The HUD is projected over a potentially complexor dense scene, such as the cluster groups 49 projected from the virtualthree-dimensional space, and provides labeling and focusing of selectclusters. The HUD includes a compass that provides a focused view of theplaced spine groups 49, concept labels that are arrangedcircumferentially and non-overlappingly around the compass, statisticsabout the spine groups 49 appearing within the compass, and a garbagecan in which to dispose of selected concepts. In one embodiment, thecompass is round, although other enclosed shapes and configurations arepossible. Labeling is provided by drawing a concept pointer from theoutermost cluster in select spine groups 49 as determined in thethree-dimensional virtual scene to the periphery of the compass at whichthe label appears. Preferably, each concept pointer is drawn with aminimum length and placed to avoid overlapping other concept pointers.Focus is provided through a set of zoom, pan and pin controls, asfurther described below with reference to FIGS. 6A-D.

In one embodiment, a single compass is provided. Referring next to FIG.2B, in a further embodiment, multiple and independent compasses can beprovided, as further described below with reference to FIG. 7 . Apre-determined number of best fit spines 48 are identified within thethree-dimensional virtual scene and labels 52 are assigned based on thenumber of clusters for each of the projected best fit spines 48appearing within the compass. A set of wedge-shaped slots 51 are createdabout the circumference of the compass. The labels are placed into theslots 51 at the end of concept pointers appearing at a minimum distancefrom the outermost cluster 45 to the periphery of the compass to avoidoverlap, as further described below with reference to FIG. 14 . Inaddition, groupings 53 of clusters can be formed by selecting conceptsor documents appearing in the compass using the user interface controls.In a still further embodiment, the cluster “spines” and certain clusters45 are placed as cluster groups 49 within a virtual three-dimensionalspace as a “scene” or world that is then projected into two-dimensionalfolder representation or alternate visualization 57, as furtherdescribed in FIGS. 16 and 17 .

Each module or component is a computer program, procedure or modulewritten as source code in a conventional programming language, such asthe C++ programming language, and is presented for execution by the CPUas object or byte code, as is known in the art. The variousimplementations of the source code and object and byte codes can be heldon a computer-readable storage medium or embodied on a transmissionmedium in a carrier wave. The display generator 32 operates inaccordance with a sequence of process steps, as further described belowwith reference to FIG. 11 .

Cluster Projection

FIG. 3 is a block diagram 60 showing, by way of example, the projectionof n-dimensional space 61 into three-dimensional space 62 andtwo-dimensional space 63 through the display generator 34 of FIG. 1 .Individual documents 14 form an n-dimensional space 61 with eachdocument concept 46 representing a discrete dimension. From a user'spoint of view, the n-dimensional space 61 is too abstract and dense toconceptualize into groupings of related document concepts 46 as thenumber of interrelationships between distinct document concepts 46increases exponentially with the number of document concepts.Comprehension is quickly lost as concepts increase. Moreover, then-dimensional space 61 cannot be displayed if n exceeds threedimensions. As a result, the document concept interrelationships aremapped into a three-dimensional virtual “world” and then projected ontoa two-dimensional screen.

First, the n-dimensional space 61 is projected into a virtualthree-dimensional space 62 by logically group the document concepts 46into thematically-related clusters 45. In one embodiment, thethree-dimensional space 62 is conceptualized into a virtual world or“scene” that represents each cluster 45 as a virtual sphere 66 placedrelative to other thematically-related clusters 45, although othershapes are possible. Importantly, the three-dimensional space 62 is notdisplayed, but is used instead to generate a screen view. Thethree-dimensional space 62 is projected from a predefined perspectiveonto a two-dimensional space 63 by representing each cluster 45 as acircle 69, although other shapes are possible.

Although the three-dimensional space 62 could be displayed through aseries of two-dimensional projections that would simulate navigationthrough the three-dimensional space through yawing, pitching androlling, comprehension would quickly be lost as the orientation of theclusters 45 changed. Accordingly, the screens generated in thetwo-dimensional space 63 are limited to one single perspective at atime, such as would be seen by a viewer looking at the three-dimensionalspace 62 from a stationary vantage point, but the vantage point can bemoved. The viewer is able to navigate through the two-dimensional space63 through zooming and panning. Through the HUD, the user is allowed tozoom and pan through the clusters 45 appearing within compass 67 and pinselect document concepts 46 into place onto the compass 67. Duringpanning and zooming, the absolute three-dimensional coordinates 65 ofeach cluster 45 within the three-dimensional space 64 remain unchanged,while the relative two-dimensional coordinates 68 are updated as theview through the HUD is modified. Finally, spine labels are generatedfor the thematic concepts of cluster spines appearing within the compass67 based on the underlying scene in the three-dimensional space 64 andperspective of the viewer, as further described below with reference toFIG. 14 .

User Interface Example

FIGS. 4A-C are screen display diagrams 80 showing, by way of example, auser interface 81 generated by the display generator 34 of FIG. 1 .Referring first to FIG. 4A, the user interface 81 includes the controlsand HUD. Cluster data is placed in a two-dimensional cluster view withinthe user interface 81. The controls and HUD enable a user to navigate,explore and search the cluster data 83 appearing within a compass 82, asfurther described below with reference to FIG. 5 . The cluster data 84appearing outside of the compass 82 is navigable until the compass iszoomed or panned over that cluster data 84. In a further embodiment,multiple and independent compasses 82 can be included in disjunctive,overlapping or concentric configurations. Other shapes andconfigurations of compasses are possible.

In one embodiment, the controls are provided by a combination of mousebutton and keyboard shortcut assignments, which control the orientation,zoom, pan, and selection of placed clusters 83 within the compass 82,and toolbar buttons 87 provided on the user interface 81. By way ofexample, the mouse buttons enable the user to zoom and pan around andpin down the placed clusters 83. For instance, by holding the middlemouse button and dragging the mouse, the placed clusters 83 appearingwithin the compass 82 can be panned. Similarly, by rolling a wheel onthe mouse, the placed clusters 83 appearing within the compass 82 can bezoomed inwards to or outwards from the location at which the mousecursor points. Finally, by pressing a Home toolbar button or keyboardshortcut, the placed clusters 83 appearing within the compass 82 can bereturned to an initial view centered on the display screen. Keyboardshortcuts can provide similar functionality as the mouse buttons.

Individual spine concepts 50 can be “pinned” in place on thecircumference of the compass 82 by clicking the left mouse button on acluster spine label 91. The spine label 91 appearing at the end of theconcept pointer connecting the outermost cluster of placed clusters 83associated with the pinned spine concept 50 are highlighted. Pinningfixes a spine label 91 to the compass 82, which causes the spine label91 to remain fixed to the same place on the compass 82 independent ofthe location of the associated placed clusters 83 and adds weight to theassociated cluster 83 during reclustering.

The toolbar buttons 87 enable a user to execute specific commands forthe composition of the spine groups 49 displayed. By way of example, thetoolbar buttons 87 provide the following functions:

-   -   (1) Select a previous document 14 in a cluster spiral;    -   (2) Select a next document 14 in a cluster spiral;    -   (3) Return to home view;    -   (4) Re-cluster documents 14;    -   (5) Select a document 14 and cluster the remaining documents 14        based on similarity in concepts to the document concepts 46 of        the selected document 14;    -   (6) Select one or more cluster concepts 47 and cluster the        documents 14 containing those selected concepts separately from        the remaining documents 14;    -   (7) Re-cluster all highlighted documents 14 separately from the        remaining documents 14;    -   (8) Quickly search for words or phrases that may not appear in        the concept list 93, which is specified through a text dialogue        box 89;    -   (9) Perform an advanced search based on, for instance, search        terms, natural language or Boolean searching, specified files or        file types, text only, including word variations, and metadata        fields;    -   (10) Clear all currently selected concepts and documents        highlighted;    -   (11) Display a document viewer;    -   (12) Disable the compass; and    -   (13) Provide help.

In addition, a set of pull down menus 88 provides further control overthe placement and manipulation of clusters within the user interface 81.Other types of controls and functions are possible.

Visually, the compass 82 emphasizes visible placed clusters 83 anddeemphasizes placed clusters 84 appearing outside of the compass 82. Theview of the cluster spines appearing within the focus area of thecompass 82 can be zoomed and panned and the compass 82 can also beresized and disabled. In one embodiment, the placed clusters 83appearing within the compass 82 are displayed at full brightness, whilethe placed clusters 84 appearing outside the compass 82 are displayed at30 percent of original brightness, although other levels of brightnessor visual accent, including various combinations of color, line widthand so forth, are possible. Spine labels 91 appear at the ends ofconcept pointers connecting the outermost cluster of select placedclusters 83 to preferably the closest point along the periphery of thecompass 82. In one embodiment, the spine labels 91 are placed withoutoverlap and circumferentially around the compass 82, as furtherdescribed below with reference to FIG. 14 . The spine labels 91correspond to the cluster concepts 47 that most describe the spinegroups 49 appearing within the compass 82. Additionally, the clusterconcepts 47 for each of the spine labels 91 appear in a concepts list93.

In one embodiment, a set of set-aside trays 85 are provided tographically group those documents 86 that have been logically markedinto sorting categories. In addition, a garbage can 90 is provided toremove cluster concepts 47 from consideration in the current set ofplaced spine groups 49. Removed cluster concepts 47 prevent thoseconcepts from affecting future clustering, as may occur when a userconsiders a concept irrelevant to the placed clusters 84.

Referring next to FIG. 4B, in a further embodiment, a user interface 81can include a navigation assistance panel 94, which provides a “bird'seye” view of the entire visualization, including the cluster data 83,84. The navigation assistance panel 94 presents a perspective-alteredrendition of the main screen display. The two-dimensional scene that isdelineated by the boundaries of the screen display is represented withinthe navigation assistance panel 94 as an outlined frame 95 that is sizedproportionate within the overall scene. The navigation assistance panel94 can be resized, zoomed, and panned. In addition, within thenavigation assistance panel 94, the compass 82 can be enabled, disabled,and resized and the lines connecting clusters in each spine group 94 canbe displayed or omitted. Additionally, other indicia 96 not otherwisevisible within the immediate screen display can be represented in thenavigation assistance panel 94, such as miscellaneous clusters that arenot part of or associated near any placed spine group 49 in the mainscreen display.

Referring finally to FIG. 4C, by default, a document 14 appears onlyonce in a single cluster spiral. However, in a still further embodiment,a document can “appear” in multiple placed clusters 83. A document 97 isplaced in the cluster 83 to which the document 97 is most closelyrelated and is also placed in one or more other clusters 83 aspseudo-documents 98. When either the document 97 or a pseudo-document 98is selected, the document 97 is highlighted and each pseudo-document 98is visually depicted as a “shortcut” or ghost document, such as withde-emphasis or dotted lines. Additionally, a text label 99 can bedisplayed with the document 97 to identify the highest scoring concept.

User Interface

FIG. 5 is an exploded screen display diagram 100 showing the userinterface 81 of FIGS. 4A-C. The user interface 81 includes controls 101,concepts list 103 and HUD 104. Clusters 102 are presented to the userfor viewing and manipulation via the controls 101, concepts list 103 andHUD 104. The controls 101 enable a user to navigate, explore and searchthe cluster space through the mouse buttons, keyboard and toolbarbuttons 87. The concepts list 103 identifies a total number of conceptsand lists each concept and the number of occurrences. Concepts can beselected from the concepts list 103. Lastly, the HUD 104 creates avisual illusion that draws the users' attention to the compass 82without actually effecting the composition of the clusters 102.

User Interface Controls Examples

FIGS. 6A-D are data representation diagrams 120, 130, 140, 150 showing,by way of examples, display zooming, panning and pinning using the userinterface 81 of FIGS. 4A-C. Using the controls, a user can zoom and panwithin the HUD and can pin spine concepts 50, as denoted by the spinelabels for placed clusters 83. Zooming increases or decreases the amountof the detail of the placed clusters 83 within the HUD, while panningshifts the relative locations of the placed clusters 83 within the HUD.Other types of user controls are possible.

Referring first to FIG. 6A, a compass 121 frames a set of cluster spines124. The compass 121 logically separates the cluster spines 124 into a“focused” area 122, that is, those cluster spines 124 appearing insideof the compass 121, and an “unfocused” area 123, that is, the remainingcluster spines 124 appearing outside of the compass 121.

In one embodiment, the unfocused area 123 appears under a visual “velum”created by decreasing the brightness of the placed cluster spines 124outside the compass 121 by 30 percent, although other levels ofbrightness or visual accent, including various combinations of color,line width and so forth, are possible. The placed cluster spines 124inside of the focused area 122 are identified by spine labels 125, whichare placed into logical “slots” at the end of concept pointers 126 thatassociate each spine label 125 with the corresponding placed clusterspine 124. The spine labels 125 show the common concept 46 that connectsthe clusters 83 appearing in the associated placed cluster spine 124.Each concept pointer 126 connects the outermost cluster 45 of theassociated placed cluster spine 124 to the periphery of the compass 121centered in the logical slot for the spine label 125. Concept pointers126 are highlighted in the HUD when a concept 46 within the placedcluster spine 124 is selected or a pointer, such as a mouse cursor, isheld over the concept 46. Each cluster 83 also has a cluster label 128that appears when the pointer is used to select a particular cluster 83in the HUD. The cluster label 128 shows the top concepts 46 that broughtthe documents 14 together as the cluster 83, plus the total number ofdocuments 14 for that cluster 83.

In one embodiment, spine labels 125 are placed to minimize the length ofthe concept pointers 126. Each spine label 125 is optimally situated toavoid overlap with other spine labels 125 and crossing of other conceptpointers 126, as further described below with reference to FIG. 14 . Inaddition, spine labels 125 are provided for only up to a predefinednumber of placed cluster spines 124 to prevent the compass 121 frombecoming too visually cluttered and to allow the user to retrieve extradata, if desired. The user also can change the number of spine labels125 shown in the compass 121.

Referring next to FIG. 6B, the placed cluster spines 124 as originallyframed by the compass 121 have been zoomed inwards. When zoomed inwards,the placed cluster spines 124 appearing within the compass 121 nearestto the pointer appear larger. In addition, those placed cluster spines124 originally appearing within the focused area 122 that are closer tothe inside edge of the compass 121 are shifted into the unfocused area123. Conversely, when zoomed outwards, the placed cluster spines 124appearing within the compass 121 nearest to the pointer appear smaller.Similarly, those placed cluster spines 124 originally appearing withinthe unfocused area 123 that are closer to the outside edge of thecompass 121 are shifted into the focused area 122.

In one embodiment, the compass 121 zooms towards or away from thelocation of the pointer, rather than the middle of the compass 121.Additionally, the speed at which the placed cluster spines 124 withinthe focused area 122 changes can be varied. For instance, variablezooming can move the compass 121 at a faster pace proportionate to thedistance to the placed cluster spines 124 being viewed. Thus, a close-upview of the placed cluster spines 124 zooms more slowly than a far awayview. Finally, the spine labels 125 become more specific with respect tothe placed cluster spines 124 appearing within the compass 121 as thezooming changes. High level details are displayed through the spinelabels 125 when the compass 121 is zoomed outwards and low level detailsare displayed through the spine labels 125 when the compass 121 iszoomed inwards. Other zooming controls and orientations are possible.

Referring next to FIG. 6C, the placed cluster spines 124 as originallyframed by the compass 121 have been zoomed back outwards and a spinelabel 125 has been pinned to fixed location on the compass 121.Ordinarily, during zooming and panning, the spine labels 125 associatedwith the placed cluster spines 124 that remain within the compass 121are redrawn to optimally situate each spine label 125 to avoid overlapwith other spine labels 125 and the crossing of other concept pointers126 independent of the zoom level and panning direction. However, one ormore spine labels 125 can be pinned by fixing the location 141 of thespine label 125 along the compass 121 using the pointer. Subsequently,each pinned spine label 125 remains fixed in-place, while the associatedplaced cluster spine 124 is reoriented within the compass 121 by thezooming or panning. When pinned, each cluster 142 corresponding to thepinned spine label 125 is highlighted. Finally, highlighted spine labels125 are dimmed during panning or zooming.

Referring lastly to FIG. 6D, the compass 121 has been panned down and tothe right. When panned, the placed cluster spines 124 appearing withinthe compass 121 shift in the direction of the panning motion. Thoseplaced cluster spines 124 originally appearing within the focused area122 that are closer to the edge of the compass 121 away from the panningmotion are shifted into the unfocused area 123 while those placedcluster spines 124 originally appearing within the unfocused area 123that are closer to the outside edge of the compass 121 towards thepanning motion are shifted into the focused area 122. In one embodiment,the compass 121 pans in the same direction as the pointer is moved.Other panning orientations are possible.

Example Multiple Compasses

FIG. 7 is a data representation diagram 160 showing, by way of example,multiple compasses 161, 162 generated using the user interface 81 ofFIGS. 4A-C. Each compass 161, 162 operates independently from any othercompass and multiple compasses can 161, 162 be placed in disjunctive,overlapping or concentric configurations to allow the user to emphasizedifferent aspects of the placed cluster spines 124 without panning orzooming. Spine labels for placed cluster spines are generated based onthe respective focus of each compass 161, 162. Thus, the placed clusterspines 166 appearing within the focused area of an inner compass 162situated concentric to an outer compass 161 result in one set of spinelabels, while those placed cluster spines 165 appearing within thefocused area of the outer compass 161 result in another set of spinelabels, which may be different that the inner compass spine labels set.In addition, each compass 161, 162 can be independently resized. Othercontrols, arrangements and orientations of compasses are possible.

Example Single and Multiple Compasses

FIGS. 8A-C are data representation diagrams 170, 180, 190 showing, byway of example, single 171 and multiple compasses 171, 181 generatedusing the user interface of FIGS. 4A-C. Multiple compasses can be usedto show concepts through spine labels concerning those cluster spinesappearing within their focus, whereas spine labels for those sameconcepts may not be otherwise generated. Referring first to FIG. 8A, anouter compass 171 frames four sets of cluster spines 174, 175, 176, 177.Spine labels for only three of the placed cluster spines 175, 176, 177in the “focused” area 173 are generated and placed along the outercircumference of the outer compass 171. Referring next to FIG. 8B, aninner compass 181 frames the set of cluster spines 174. Spine labels forthe placed cluster spines 174 in the “focused” area 182 are generatedand placed along the outer circumference of the inner compass 181, eventhough these spine same labels were not generated and placed along theouter circumference of the outer compass 171. Referring lastly to FIG.8C, in a further embodiment, spine labels for the placed cluster spinesin the “focused” area 173 are generated and placed along the outercircumference of the original outer compass 171. The additional spinelabels have no effect on the focus of the outer compass 171. Othercontrols, arrangements and orientations of compasses are possible.

Example Cluster Spine Group

FIG. 9 is a data representation diagram 210 showing, by way of example,a cluster spine group 49. One or more cluster spine groups 49 arepresented. In one embodiment, the cluster spine groups 49 are placed ina circular arrangement centered initially in the compass 82, as furtherdescribed below with reference to FIG. 10 . A set of individual best fitspines 211, 213, 216, 219 are created by assigning clusters 45 sharing acommon best fit theme. The best fit spines are ordered based on spinelength and the longest best fit spine 121 is selected as an initialunique seed spine. Each of the unplaced remaining best fit spines 213,216, 219 are grafted onto the placed best fit spine 211 by firstbuilding a candidate anchor cluster list. If possible, each remainingbest fit spine 216, 219 is placed at an anchor cluster 218, 221 on thebest fit spine that is the most similar to the unplaced best fit spine.The best fit spines 211, 216, 219 are placed along a vector 212, 217,219 with a connecting line drawn in the visualization 54 to indicaterelatedness. Otherwise, each remaining best fit spine 213 is placed at aweak anchor 215 with a connecting line 214 drawn in the visualization 54to indicate relatedness. However, the connecting line 214 does notconnect to the weak anchor 215. Relatedness is indicated by proximityonly.

Next, each of the unplaced remaining singleton clusters 222 are looselygrafted onto a placed best fit spine 211, 216, 219 by first building acandidate anchor cluster list. Each of the remaining singleton clusters222 are placed proximal to an anchor cluster that is most similar to thesingleton cluster. The singleton clusters 222 are placed along a vector212, 217, 219, but no connecting line is drawn in the visualization 54.Relatedness is indicated by proximity only.

Cluster Spine Group Placement Example

FIG. 10 is a data representation diagram 230 showing, by way ofexamples, cluster spine group placements. A set of seed cluster spinegroups 232-235 are shown evenly-spaced circumferentially to an innermostcircle 231. No clusters 80 assigned to each seed cluster spine groupframe a sector within which the corresponding seed cluster spine groupis placed.

Cluster Spine Group Overlap Removal Example

FIG. 11 is a data representation diagram 240 showing, by way of example,cluster spine group overlap removal. An overlapping cluster spine groupis first rotated in an anticlockwise direction 243 up to a maximum angleand, if still overlapping, translated in an outwards direction 244.Rotation 245 and outward translation 246 are repeated until the overlapis resolved. The rotation can be in any direction and amount of outwardtranslation any distance.

Method Overview

FIG. 12 is a flow diagram showing a method 250 for providing a userinterface 81 for a dense three-dimensional scene, in accordance with theinvention. The method 250 is described as a sequence of processoperations or steps, which can be executed, for instance, by a displayedgenerator 34 (shown in FIG. 1 ).

As an initial step, documents 14 are scored and clusters 45 aregenerated (block 251), such as described in commonly-assigned U.S. Pat.No. 7,610,313, issued Oct. 27, 2009, the disclosure of which isincorporated by reference. Next, clusters spines are placed as clustergroups 49 (block 252), such as described in commonly-assigned U.S. Pat.No. 7,191,175, issued Mar. 13, 2007, and U.S. Pat. No. 7,440,622, issuedOct. 21, 2008, the disclosures of which are incorporated by reference,and the concepts list 103 is provided. The HUD 104 is provided (block253) to provide a focused view of the clusters 102, as further describedbelow with reference to FIG. 13 . Finally, controls are provided throughthe user interface 81 for navigating, exploring and searching thecluster space (block 254). The method then terminates.

HUD Generation

FIG. 13 is a flow diagram showing the routine 260 for providing a HUDfor use in the method 250 of FIG. 12 . One purpose of this routine is togenerate the visual overlay, including the compass 82, that defines theHUD.

Initially, the compass 82 is generated to overlay the placed clusterslayer 102 (block 261). In a further embodiment, the compass 82 can bedisabled. Next, cluster concepts 47 are assigned into the slots 51(block 263), as further described below with reference to FIG. 14 .Following cluster concept 47 assignment, the routine returns.

Concept Assignment to Slots

FIG. 14 is a flow diagram showing the routine 270 for assigning concepts47 to slots 51 for use in the routine 260 of FIG. 13 . One purpose ofthis routine is to choose the locations of the spine labels 91 based onthe placed clusters 83 appearing within the compass 82 and availableslots 51 to avoid overlap and crossed concept pointers.

Initially, a set of slots 51 is created (block 271). The slots 51 aredetermined to circumferentially defined around the compass 82 to avoidcrossing of navigation concept pointers and overlap between individualspine labels 91 when projected into two dimensions. In one embodiment,the slots 51 are determined based on the three-dimensional Cartesiancoordinates 65 (shown in FIG. 3 ) of the outermost cluster in selectspine groups 49 and the perspective of the user in viewing thethree-dimensional space 62. As the size of the compass 82 changes, thenumber and position of the slots 51 change. If there are fewer slotsavailable to display the cluster concepts 47 selected by the user, onlythe number of cluster concepts 47 that will fit in the slots 51available will be displayed.

Next, a set of slice objects is created for each cluster concept 47 thatoccurs in a placed cluster 83 appearing within the compass 82 (block272). Each slice object defines an angular region of the compass 82 andholds the cluster concepts 47 that will appear within that region, thecenter slot 51 of that region, and the width of the slice object,specified in number of slots 51. In addition, in one embodiment, eachslice object is interactive and, when associated with a spine label 91,can be selected with a mouse cursor to cause each of the clusterconcepts 47 in the display to be selected and highlighted. Next, framingslice objects are identified by iteratively processing each of the sliceobjects (blocks 273-276), as follows. For each slice object, if theslice object defines a region that frames another slice object (block274), the slice objects are combined (block 275) by changing the centerslot 51, increasing the width of the slice object, and combining thecluster concepts 47 into a single slice object. Next, those sliceobjects having a width of more than half of the number of slots 51 aredivided by iteratively processing each of the slice objects (block277-280), as follows. For each slice object, if the width of the sliceobject exceeds the number of slots divided by two (block 278), the sliceobject is divided (block 279) to eliminate unwanted crossings of linesthat connect spine labels 91 to associated placed clusters 83. Lastly,the cluster concepts 47 are assigned to slots 51 by a set of nestedprocessing loops for each of the slice objects (blocks 281-287) andslots 51 (blocks 282-286), as follows. For each slot 51 appearing ineach slice object, the cluster concepts 47 are ordered by angularposition from the slot 51 (block 283), as further described below withreference to FIG. 13 . The cluster concept 47 whose correspondingcluster spine has the closest angularity to the slot 51 is selected(block 284). The cluster concept 47 is removed from the slice object andplaced into the slot 51 (block 285), which will then be displayed withinthe HUD layer 103 as a spine label 91. Upon the completion of clusterconcept 47 assignments, the routine returns.

Cluster Assignment Example

FIG. 15 is a data representation diagram 290 showing, by way of example,a cluster assignment to a slot 51 within a slice object. Each sliceobject 291 defines an angular region around the circumference of thecompass 82. Those slots 292 appearing within the slice object 291 areidentified. A spine label 293 is assigned to the slot 292 correspondingto the cluster spine having the closest angularity to the slot 292.

Alternate User Interface

FIGS. 16 and 17 are screen display diagrams 300 showing, by way ofexample, an alternate user interface 301 generated by the displaygenerator 34 of FIG. 1 . Referring first to FIG. 16 , in a furtherembodiment, the alternate user interface 301 includes a navigable folderrepresentation of the three-dimensional space 62 projected onto atwo-dimensional space 63 (shown in FIG. 3 ). Cluster data is presentedwithin the user interface 301 in a hierarchical tree representation offolders 302. Cluster data is placed within the user interface 301 using“Clustered” folders 303 that contain one or more labeled spine groupfolders 305, 306, such as “birdseed” and “roadrunner.” Where applicable,the spine group folders can also contain one or more labeled best fitspine group folders 307, such as “acme” and “coyote.” In addition,uncategorized cluster data is placed within the user interface 301 using“Other” folders 304 that can contain one or more labeled “No spine”folders 308, which contain one or more labeled folders 311 for placedclusters 83 that are not part of a spine group, such as “dynamite.” The“Other folders” 304 can also contain a “Miscellaneous” folder 309 and“Set-Aside Trays” folder 310 respectively containing clusters that havenot been placed or that have been removed from the displayed scene.Conventional folder controls can enable a user to navigate, explore andsearch the cluster data 83. Other shapes and configurations of navigablefolder representations are possible.

The folders representation 302 in the alternate user interface 301 canbe accessed independently from or in conjunction with thetwo-dimensional cluster view in the original user interface 81. Whenaccessed independently, the cluster data is presented in the foldersrepresentation 302 in a default organization, such as from highestscoring spine groups on down, or by alphabetized spine groups. Otherdefault organizations are possible. When accessed in conjunction withthe two-dimensional cluster view, the cluster data currently appearingwithin the focus area of the compass 82 is selected by expanding foldersand centering the view over the folders corresponding to the clusterdata in focus. Other types of folder representation access are possible.

Referring next to FIG. 17 , the user interface 301 can also beconfigured to present a “collapsed” hierarchical tree representation offolders 312 to aid usability, particularly where the full hierarchicaltree representation of folders 302 includes several levels of folders.The tree representation 312 can include, for example, only two levels offolders corresponding to the spine group folders 305, 306 and labeledbest fit spine group folders 307. Alternatively, the tree representationcould include fewer or more levels of folders, or could collapsetop-most, middle, or bottom-most layers. Other alternate hierarchicaltree representations are possible.

FIG. 18 is a screenshot showing, by way of example, a codingrepresentation 330 for each cluster. Each cluster 332 of documents isdisplayed as a pie graph. Specifically, the pie graph can identifyclassification codes assigned to documents in that cluster, as well as afrequency of occurrence of each assigned classification code. Theclassification codes can include “privileged,” “responsive,” or“non-responsive,” however, other classification codes are possible. A“privileged” document contains information that is protected by aprivilege, meaning that the document should not be disclosed or“produced” to an opposing party. Disclosing a “privileged” document canresult in an unintentional waiver of the subject matter disclosed. A“responsive” document contains information that is related to the legalmatter, while a “non-responsive” document includes information that isnot related to the legal matter. The classification codes can beassigned to the documents via an individual reviewer, automatically, oras recommended and approved.

Each classification code can be assigned a color. For instance,privileged documents can be associated with the color red, responsivewith blue, and non-responsive with white. A number of documents assignedto one such classification code is totaled for each of theclassification codes and used to generate a pie chart based on the totalnumber of documents in the cluster. Thus, if a cluster has 20 documentsand five documents are assigned with the privileged classification codeand two documents with the non-responsive code, then 25% of the piechart would be colored red, 10% would be colored white, and if theremaining documents have no classification codes, the remainder of thepie chart can be colored grey. However, other classification codes,colors, and representations of the classification codes are possible.

In one embodiment, each portion of the pie, such as represented by adifferent classification code or no classification code, can be selectedto provide further information about the documents associated with thatportion. For instance, a user can select the red portion of the pierepresenting the privileged documents, which can provide a list of theprivileged documents with information about each document, includingtitle, date, custodian, and the actual document or a link to the actualdocument. Other document information is possible.

The display can include a compass 331 that provides a focused view ofthe clusters 332, concept labels 333 that are arranged circumferentiallyand non-overlappingly around the compass, and statistics about theclusters appearing within the compass. In one embodiment, the compass isround, although other enclosed shapes and configurations are possible.Labeling is provided by drawing a concept pointer from the outermostcluster to the periphery of the compass at which the label appears.Preferably, each concept pointer is drawn with a minimum length andplaced to avoid overlapping other concept pointers. Focus is providedthrough a set of zoom, pan and pin controls

In a further embodiment, a user can zoom into a display of the clusters,such as by scrolling a mouse, to provide further detail regarding thedocuments. For instance, when a certain amount of zoom has been applied,the pie chart representation of each cluster can revert to arepresentation of the individual documents, which can be displayed ascircles, such as described above with reference to FIGS. 4A-C and 6A-C.In one embodiment, the zoom can be measured as a percentage of theoriginal display size or the current display size. A threshold can thenbe applied to the percentage of zoom and if the zoom exceeds thethreshold, the cluster representations can revert to the display ofindividual documents, rather than a pie chart.

FIG. 19 is a screenshot 340 showing, by way of example, documentclusters 341 with keyword highlighting. A display of document clusters341 can show individual documents 342 within one such cluster, whereeach document is represented as a circle. Each of the documents can becolored based on a classification code assigned to that document, suchas automatically, by an individual reviewer, or based on arecommendation, which is approved by an individual. For example,privileged documents can be colored red, while responsive documents canbe colored blue, and non-responsive documents can be colored light blue.

The cluster display can include one or more search fields into whichsearch terms 345 can be entered. The search terms can be agreed upon byboth parties subject to a case under litigation, a document reviewer, anattorney, or other individual associated with the litigation case.Allowing a user to search the documents for codes helps that user toeasily find relevant documents via the display. Additionally, the searchprovides a display based on what the user thinks is important based onsearch terms provided and what the system thinks is important based onhow the documents are clustered and the classification codes areassigned. In one example, the display can resemble a heat map with a“glow” or highlighting 344 provided around one or more representationsof the documents and clusters, as described below.

Once the search terms are entered, a search is conducted to identifythose documents related to the search terms of interest. Prior to orduring the search, each of the search terms are associated with aclassification code based on the documents displayed. For instance,based on a review of the documents for each classification code, a listof popular or relevant terms across all the documents for that code areidentified and associated with that classification code. For example,upon review of the privileged document, terms for particularindividuals, such as the attorney name and CEO name are identified asrepresentative of the privileged documents. Additionally, junk terms canbe identified, such as those terms frequently found in junk email, mail,and letters. For example, certain pornographic terms may be identifiedas representative of junk terms.

Upon identification of the documents associated with the search terms, acolor 343 is provided around the document based on the search term towhich the document is related or includes. The colors can be set byattorneys, administrators, reviewers, or set as a default. For example,a document that includes the CEO's name would be highlighted red, suchas around the red circle if the document is associated with theclassification code of privileged. Alternatively, if the circlerepresenting the document is colored blue for responsive, the red colorfor the search term is colored around the blue circle. The strength ofthe highlighted color, including darker or lighter, can represent arelevance of the highlighted document or concept to the search terms.For example, a document highly related to one or more of the searchterms can be highlighted with a dark color, while a document with lowerrelevance can be associated with a lighter highlighted color.

When the document color and the search term highlight colors match, anagreement between what the user believes to be important matches withwhat the system identifies to be important. However, if the colors donot match, a discrepancy may exist between the user and the system anddocuments represented by disparate colors may require further review bythe user. Alternatively, one or more junk terms can be entered as thesearch terms to identify those documents that are likely “junk” and toensure that those documents are not coded as privileged or responsive,but if so, the user can further review those documents. Further,clusters that do not include any documents related to the search termscan also be highlighted a predetermined color.

In addition to the documents, a cluster can also include a highlighting343 around the cluster based on a relevance of that cluster to thesearch terms. The relevance can be based on all the documents in thatcluster. For instance, if 20 of the documents are related to aprivileged term and another is related to a non-responsive term, thecluster can be highlighted around the cluster circle with the color redto represent the privileged classification. Additionally, if eachdocument related to a privileged term and is also coded as privileged,there is a strong agreement that the cluster correctly includesprivileged documents.

In a further embodiment, the search terms can be used to identifydocuments, such as during production to fulfill a production request. Ina first scenario, the search terms are provided and a search isconducted. Based on the number of terms or the breadth of the terms, fewdocuments may be identified as relevant to the search terms.Additionally, the search terms provided may not be representative of theresults desired by the user. Therefore, in this case, the user canreview terms or concepts of a responsive cluster and enter the furtherterms to conduct a further search based on the new terms. A responsivecluster can include those clusters with documents that are highlightedbased on the search terms and considered relevant to the user.

Alternatively, if the terms are overly broad, a large number ofdocuments will show highlighting as related to the terms and the resultsmay be over-inclusive of documents that have little relevance to theactual documents desired by the user. The user can then identifynon-responsive clusters with highlighted documents not desired by theuser to identify terms having false positives, such that they appearrelevant to the search terms. The user can then add exclusionary termsto the search, remove or replace one or more of the terms, and add a newterm to narrow the search for desired documents. To identify new termsor replace terms, a user can review the terms or concepts of aresponsive cluster. The search terms can include Boolean features andproximity features to conduct the search. For example, the search termsfor “fantasy,” “football,” and “statistics” may provide over-inclusiveresults. A user then looks at responsive clusters to identify a conceptfor “gambling” and conducts a new search based on the four search terms.The terms or concepts can be identified from one or more documents orfrom the cluster labels.

A list of the search terms can be provided adjacent to the display witha number of documents or concepts identified in the display as relevantto that search term. Fields for concepts, selected concepts, quickcodes, blinders, issues, levels, and saved searches can also beprovided.

FIG. 20 is a screenshot 350 showing, by way of example, documentsclusters 351 without search term highlighting. The search termhighlighting feature can be turned off with a single click to reducenoise in the display. Massive amounts of data can be available and maybe too much data to reasonably display at a single time. Accordingly,the data can be prioritized and divided to display reasonable datachunks at a single time. In one example, the data can be prioritizedbased on user-selected factors, such as search term relation, predictivecoding results, date, code, or custodian, as well as many other factors.Once one or more of the factors are selected, the documents 352 in acorpus are prioritized based on the selective factor. Next, thedocuments are ordered based on the prioritization, such as with thehighest priority document at a top order and the lowest prioritydocument at the bottom. The ordered documents can then be divided intobins of predetermined sizes, randomly selected sizes, or as neededsizes. Each bin can have the same or a different number of documents.The documents in each bin are then provided as one page of the clusterdisplay.

The documents are divided by family, such that a bin will includedocuments of the same family. For example, an original email willinclude in its family, all emails in the same thread, such as reply andforwarded emails, and all attachments. The cluster display is dependenton the documents in each bin. For instance, the bin number may be set at10,000 documents. If a single cluster includes 200 documents and 198 ofthe documents are prioritized with numbers before 10,000 and theremaining two documents have priorities over 10,000, then the clusterwill be displayed as a first page with the 198 documents, but not thetwo documents of lower priority. In one embodiment, the two documentsmay show as a cluster together on the page corresponding with the bin towhich the two documents belong. The next page will provide a clusterdisplay of the next 10,000 documents, and so on. In this manner, theuser can review the documents based on priority, such that the highestpriority documents will be displayed first. A list 353 of pages can beprovided at a bottom of the display for the user to scroll through.

In a further example, the displays are also dependent on the prioritizeddocuments and their families. For instance, one or more of the first10,000 prioritized documents, may have additional family members, whichcan change the number of documents included in a bin, such as to 10,012.

While the invention has been particularly shown and described asreferenced to the embodiments thereof, those skilled in the art willunderstand that the foregoing and other changes in form and detail maybe made therein without departing from the spirit and scope of theinvention.

What is claimed is:
 1. A computer-implemented system for displayingmulti-dimensional clusters of documents on a two-dimensional screen, thesystem comprising: a clustering component to form, in athree-dimensional cluster space, a plurality of clusters comprising oneor more documents, each cluster of the plurality of clusters having anassociated cluster concept, each document having an associated conceptscore, and each document assigned to a cluster based on the conceptscore; a cluster spine placement component to map each cluster to acorresponding cluster spine from a plurality of spines, such that eachspine comprises a group of clusters sharing a concept; and a displaygenerator to generate a visualization of the clusters and spines intwo-dimensional space for projection onto a two-dimensional display, andto generate a heads-up display for projection onto a two-dimensionaldisplay, the heads-up display including: a compass logically framing thecluster spines, the compass including a plurality of slots positionedcircumferentially around the compass, and a plurality of labels, eachlabel of the plurality of labels indicating the associated clusterconcept for a corresponding spine; and a concept pointer from each labelto its corresponding spine from among of the plurality of spines.
 2. Thecomputer-implemented system of claim 1, wherein the compass furthercomprises plurality of slots positioned circumferentially around thecompass, each cluster spine displayed within a corresponding slot, andeach label disposed within a slot corresponding to its associated spine.3. The computer-implemented system as described in claim 1, wherein atleast one spine comprises a plurality of clusters arranged linearly. 4.The computer-implemented system as described in claim 1, wherein theclusters and spines are displayed in three-dimensional space.
 5. Thecomputer-implemented system as described in claim 1, wherein the conceptscore is generated from one or both of concepts and terms extracted fromthe documents.
 6. The computer-implemented system as described in claim1, wherein the compass logically separates cluster spines into a focusedarea displaying some of the cluster spines, and an unfocused areadisplaying remaining cluster spines, and wherein each concept pointerextends from a label to a corresponding cluster spine in the focusedarea.
 7. The computer-implemented system as described in claim 1,wherein the heads-up display provides controls for one or more ofnavigating, exploring, and searching the visualization.
 8. Thecomputer-implemented system as described in claim 1, further comprising:a division module to divide the display of clusters, comprising: apriority module to prioritize documents; an order module to order thedocuments based on the prioritization; a bin classification module todivide the ordered documents into bins; and a bin display module toseparately display the documents associated with each bin.
 9. Acomputer-implemented method for displaying multi-dimensional clusters ofdocuments, the method comprising: forming, via a clustering component, aplurality of clusters of one or more documents, associating with eachcluster a cluster concept, associating with each document a clusterconcept score; assigning each document to a cluster based on thedocument's concept score; mapping, via a cluster spine placementcomponent, each cluster to a corresponding cluster spine from aplurality of spines, such that each spine comprises a group of clusterssharing a concept; displaying a heads-up display, the heads-up displaycomprising: a visualization showing the clusters and spines and acompass logically framing the cluster spines, the compass including aplurality of slots positioned circumferentially around the compass, anda plurality of labels, each label of the plurality of labels indicatingthe associated cluster concept for a corresponding spine; and a conceptpointer from each label to its corresponding spine from among of theplurality of spines.
 10. The computer-implemented method as described inclaim 9, wherein the clusters and spines are displayed intwo-dimensional space for projection onto a two-dimensional display. 11.The computer-implemented method as described in claim 9, wherein theclusters and spines are displayed in three-dimensional space.
 12. Thecomputer-implemented method as described in claim 9, wherein the conceptscore is generated from one or both of concepts and terms extracted fromthe documents.
 13. The computer-implemented method as described in claim9, wherein the compass logically separates cluster spines into a focusedarea displaying some of the cluster spines, and an unfocused areadisplaying remaining cluster spines, and wherein each concept pointerextends from a label to a corresponding cluster spine in the focusedarea.
 14. The method as described in claim 9, wherein the heads-updisplay provides controls for one or more of navigating, exploring, andsearching the visualization.
 15. The computer-implemented method asdescribed in claim 9, further comprising: dividing the display ofclusters via a division module, the division module comprising: apriority module to prioritize documents; ordering the documents based onthe prioritization via an ordering module; dividing the ordereddocuments into bins; and separately displaying the documents associatedwith each bin.
 16. A non-volatile computer-readable storage mediumhaving computer-executable code thereon, the computer code, whenexecuted by a computer processor, causing a computer to perform a methodfor displaying multi-dimensional clusters of documents on atwo-dimensional screen, the code comprising: code for forming, in athree-dimensional cluster space, a plurality of clusters comprising oneor more documents, each cluster of the plurality of clusters having anassociated cluster concept, each document having an associated conceptscore, and each document assigned to a cluster based on the conceptscore; code for mapping each cluster to a corresponding cluster spinefrom a plurality of spines, such that each spine comprises a group ofclusters sharing a concept; and code for generating a visualization ofthe clusters and spines in two-dimensional space for projection onto atwo-dimensional display, and for generating a heads-up display forprojection onto a two-dimensional display, the heads-up displayincluding: a compass logically framing the cluster spines, the compassincluding a plurality of slots positioned circumferentially around thecompass, and a plurality of labels, each label of the plurality oflabels indicating the associated cluster concept for a correspondingspine; and a concept pointer from each label to its corresponding spinefrom among of the plurality of spines.
 17. The non-volatilecomputer-readable storage medium of claim 16, wherein the compassfurther comprises plurality of slots positioned circumferentially aroundthe compass, each cluster spine displayed within a corresponding slot,and each label disposed within a slot corresponding to its associatedspine.
 18. The non-volatile computer-readable storage medium of claim16, wherein the concept score is generated from one or both of conceptsand terms extracted from the documents.
 19. The non-volatilecomputer-readable storage medium of claim 16, wherein the compasslogically separates cluster spines into a focused area displaying someof the cluster spines, and an unfocused area displaying remainingcluster spines, and wherein each concept pointer extends from a label toa corresponding cluster spine in the focused area.
 20. The non-volatilecomputer-readable storage medium of claim 16, wherein the heads-updisplay provides controls for one or more of navigating, exploring, andsearching the visualization.